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ABSTRACT 



Ways to approach the evaluation of South Carolina's 

to 



Parent Education Program are examined. The program's purpose is 
improve children's school success by strengthening the family, 
particularly during the children's first 5 years. Program goals are 
to; (1) demonstrate effective methods of parent training and support 
that will enable parents to excel in their role as the principle 
teachers of their preschool children; (2) develop and coordinate 
appropriate services based on the growth and development of the 
child; (3) improve the education, skills, and employment of parents; 
and (4) assure preschool developmental screening for all children 
whose families are served. Pilot projects of the program are guided 
by several key components, including parent training, parent and 
family services, literacy training and other forms of adult training, 
and developmental screenings. The application of Jacob's five-level 
program evaluation design in combination with other methodologies for 
the evaluation of South Carolina's program provides an example of the 
way in which a statewide assessment framework might emerge. Needs 
assessment, common delivery systems, parent and family support, 
interagency collaboration, staff training, and a focus on at-risk 
families are common evaluation methods. The need for pilot project 
evaluations to focus on descriptive data is noted. Strategies to 
ensure that all components are integrated into an effective design 
are suggested for longitudinal evaluations. Contains lO references. 
(LB) 
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The evaluation of psrent education progams is critical to furthering our 
understanding of how various designs can be strengthened. Recent advancements in 
the use of multidimensional evaluation in different social sciences have fostered more 
aeative proyam and assessment perspectives (Chen. 1990). In particular, parent 
education evaluations are attempting to promote a more defined sense of proyam- 
psi'ei>t sensitive proceseee and to thus foster a mors proactive orientation among 
parent educators. 

Five elements of effective and meaningful parent education 
evaluation are: inclusiveness. formative and summative strategies, and 
content/procsss factors. Parent education evaluation needs to be inclusive by 

design; attempting to attend to the many vanaoles. nuances and processes that 
comprise this cnallenging a'^d complex field (Jacobs. 1988), it aiso requres the use of 
formative strategies that can account for the many orog-am-oarent dynamics that 
emerge curing mot simply after) the imolementation (Powell. 1988V Summative 
evaluations are also imoortant. creferaDiy iniced to formative activities and functioning 
as a means ot continual teecbacK to crcg'am 'caoers (^^eiss A jacoos. 1988). Wjthin 
Tis ^cr^^ative-summative structure a aual *ocus s neecJed on content and process 
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variables: providing essential perspectives on the substance and human dynamics of 
prog-ams (Powell, 1988). 

Considerations In Evaluating South Carolina's Parent Education Prc^sram 

The basic purpose of South Carolina 's Parent E<iucation f^ogram is to 
improve children's school success through strengthening the family (birth - five years of 
age). Specifically, the stated goals are: 

'To demonstrate effective methods of parent training and support that will enable 
parents to excel in their role as the principle teachers of their preschool chilcten. 

*To develop and coordinate appropriate services based on the growth and 
development of the child. 

*To improve the education, skills, and employment of parents. 

•To assure preschool developmental screening for all chil(ten whose families are 
served. 

In carrying out these goals, the focus is on the use of "pilot projects' as an 
arena for exploring various designs and strategies. These projects are guided by the 

following: 

*Key pro^'am components inctuae oareni training, parent/famiiy services, 
!lteracy/adult training and developmental screenings. 

*Common program methods inciuae needs assessment, delivery systems, 
.'arentytamiiv suddctt interaaencv collaboration siar^ Tainina. *ocus on at-risK families, 
ana an evaiuaiicn/accumentaiion system. 
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*Pilot project experimentation with difterent designs and strategies within the key 
components and common methods guidelines. 

As the design indicates, the South Carolina Prog-am^ focused on a process-oriented 
approach. 

Toward An Evaluation Frameworle 

Recent parent education evaluations reflect a move toward more 
comprehensive and viable schemes. The Missouri Parents As Teachers project has 
provided context data on children s developmental status that is more complete than 
past assessments (Pfannenstiel & Seltzer. 1985) Evidence of further elaboration of 
the evaluation process is seen in the Prenatal And Early infancy Prqect[Q\f^, 1988). 
Through the use of a comprehensive design, data on child, parent, parent-child, family 
functioning, and informal/formal soda! support are interrelated with prog-am processes 
and outcomes. Additional ecological assessment factors are being closely examined 
by Powell (1988); particularly with regards to program-participant dynamics. With the 
evolution of more ecc'ogicai designs has come a new conceptual asis for shaping 
and carrying out the evaluation process. 

Of palicular significance is JacoDs (1988) muttHevei proyam evaluation 
.sc^.eme. This 5-Lsvel system provides a viable foundation for moving toward an 
evaluation frameworK for large-scale progams such as South Carolinas. Smaller 
oarent education efforts will aiso 'ind this design very useful m articulating both 
orogam and evaluation elements. The design ceoicts a 5-Level match between (and 
witnin) DTogram and development neeos: Preimoiementation, Accountability Prog^m, 
Clarification, Progess Toward Objectives, and P^ogam 'mpact. This system (which 
"-.as crawn Tom the wotk ot ,'nany Darent/tamiiy eaucation stucies) accounts tor the 
^neraing aaia elements 'hat occur within :rogam aeveiooment ana for the 
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interactional nature of proyam-partiaptint dynamics. Further it is structured to support 
the needed formative evaluation processes that are predominate in pilot projects, the 
articulation of critical data elements for tracking process and outcome factors, and the 
development of functional longitudinal evaluation schemes. 

The work of Powell, 1968, 1989) and others (See Weiss 8i Jacobs. 1988 for a 
comprehensive source) provides additional substance to an emerging framework 
through the articulation of a 3-Level methodology system. The methods (descriptive 
data, data management, and analytic research) provide a means for actualizing 
comprehensive evaluations. 

The application of Jacobs' 5-Level design combined with appropriate 
methodologies to the evaluation of South Carolina s prog-am provides an example of 
how such a statewide assessment framework might emerge. South Carol's 
Program has four core components that require continual assessment within an 
ecological context: parenf training, parent/family support services, iiteracy/adult 
training, and developmental screening, in addition, the progam has identified seven 
common methods that should permeate the work of local projects: needs 
assessment, common delivery systems, parent/family support, interagency 
collaboration, siiff training, an at-risk family focus, and a system for carrying out 
appropriate documentation and evaluation, These core components and common 
methods can be thaoughly field-tested in the wlot proiects selected to experiment 
with the overall goals of the progam. Given the experiences of comparable state 
prog-ams. the pilot pro|ect evaluations might best focus on the processes articulated in 
Levels 1 & 2 of Jacobs design (Eilwood. 1988). The types of information needed at 
these levels correspond logically and ecoloGically with :^e likely contexts of the pilot 
proiects. Also, the descriptive dimension of the evaluation snould be the initial focus of 
aata collection. At this stage of program evolution rich desaiptions are needed on 
•Elements sucn as: neeas loentification strategies, parent training experiences, varying 
:e!ivery systems, .nteragency cciiaDoraticn aciivities ana ciner crccess factors. 
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In effect, the evaluation design must relate the ecological dimension of th» 
study process to the formative experiences of the pilot projects. Through the use of this 
approach. short-terTi desaiptive assessments can produce data that strengthen the 
basis for evaluating outcomes of a longitudinal nature. It also assures that the process 
reflect the real experiences of staff and parents involved in the project's evolution. 

The Pilot Projects: Toward An Evaluation Orientation 

Pilot project evaluations such as South Carolina's need to focus on descriptive 
data that are integ'al to the mission, core components and cor.mon methods of the 
prog-ams being field-tested. Using a multi-level (Jacobs. 1988). ecological (Powell. 
1988. Dym. 1988) approach, pilot project assessments can focus on data typically 
collected in Levels 1 & 2 of Jacobs design. Descriptive, interpretive and analytic 
assessment tools and perspectives should be used to support this focus. The following 
are important factors in the South Carolina pilot projects being studied; 

*Key elements of the statewide mission as they are Deing implemented by the pilot's. 

*Local experimentation with the core components and common methods as they 
were articulated in the state mandate 

*Comparative analysis of pilot project findings with similar orogams in other states. 

"nternai progam-orocess evaluation vvith rsgarcs to aacn Dilot s experiences m 
::roaram develooment. 

Utiiizing moicators implied m Levels ■< i 2 r .acoos aesign, cilot oroiects can 
assess their exceriences A/ith recarcs to: r.issicn. ciesign. activities, panicipation 
:atterns. :roieci resources, ana eariy erfectiveness aaia. -or examoie. within the 
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construct of "miasion" prog'ams can examine the following: 
*What is it they hope to achieve? 
"What needs are they trying to meet? 
*How are they hoping to meet these needs? 

Likewise, issues such as the following are worth exploring in the "design"' category; 

*What is the initial design? 

•How was the design shaped and by whom? 

*What changes have taken place during the project's early implementation? 

A similar process can be can-ied out with all of the ma|or elements of the pilot projects. 

Of critical importance in this process is the analysis of the core components and 
common methods of each of the pilot pro|ects. Questions such as ,iie following need to 
be fully e) iored during the pilot project phase. 

*What activities and services are being delivered by the projects within eich of 

the core components (parent training, parent/famiiy services, iiteracy/aduit training, 
aeveiopmental assessments)'? 

'Who !S involved m the aeiivery of these services ano activities'' 
"-CW ar* "^e -services ana activities "ieing r^eiivered'' 
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*Who IS palicipating in the services and activities'? 

'What are the participation patterns of those panicipating in pro|ect services? 

Additional issues need to be explored within the 'effectiveness' dimension of the 
projects, palicuiariy regarding the various common methods used to achieve 
pro-am goals. 

•What methodologies (home-visits, g-oup meetings as examples) are being used to 
achieve project goals? 

*What training experiences are staff receiving to prepare them for achieving 
effectiveness with different methodologies? 

•How are project resources being deployed to best achieve goals? 

•Is a 'balance' being achieved between services proviaed to children and to 
parents? 

•How are interagency services being cooroinated and delivered? 

'What strategiee are being used to engage parents in the project s decision 
making Drocess? 

•How are oro|ects documenting and evaluating *ne'r emerging process and 
::esiGn elements? 

°'lot pro)ect evaluations orovide ^er^aDs the "^ost amenacie and fertile arena 
•cr •?xolor!Pg the avnamics :t oroaam ^voiution arc *cr examining the critical 
rtricacies of croaam/Darent reiationsnios ceaiiv Te aaia generated from this 



19 



procwa ahould provide a foundation for the emergence of long-term asaewment 
plans. 

Toward A Longitudinal Evaluation Perspective 

Stakeholdars in Isrge scale parent education efforts like South Carolina's want 
effectiveness and impact data. Three sources usually have a strong influence on the 
emerging structure of long-term evaluation: state mandated proyam elements, 
professional evaluation criteria, and local progam development as actualized in the 
form of pilot projects. These sources interact to create the process and parameters 
from vyhich long-term evaluation emerges. 

In a similar manner the components of pilot pro|ect assessments, longitudinal 
evaluation, and data management systems should interrelate to provide a design that 
adctesses the evaluation needs. In South Carolina s case, all three components must 
relate to and reflect the broad mission, key components, and common methods of the 
state s mandate. Yet each component has a unique role to play To assure that all of 
the components are integated into an effective design the following strategies are 
suggested: 

•Develop a "working paper ' on possible directions tor the longitudinal evaluation. This 
paper should include pilot project findings (where complete or where in process), 
mandated data elements (usually articulated in the prog'ams legislation), and 
research findings from projects of a similar nature 

•*^'nalize the "^ocus' of the plan through staicenoicSer nout and through feedback and 
results from the individual oilot oroiecis 

•^•eio-tesT *he oian 'hrougn *he oiiot oroiec^ evaluation ixocess "his fisid-testing 
ircuic: 'ecus :n 'Bfining prccram aireacn ^na tr.e evaluation crccsss itself. 
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In canTing out evaluation of parent education an ecological, multi-dimensional 
perspeaive must be maintained, i; is imponant that evaluation schemes promote the 
integ-ity of programs. The ultimate goal is to nurture the Jcinds of experiences that 
empower perents and child-en; engaging them in mutually responsive and rewarding 
activities. 

What Can Be Learned From Statewide Efforts? 

Evaluations of various parent education efforts have provided many insights 
related to program outcomes, parent/family needs, the value of "services ' to particular 
populations, usefulness of different strategies in different contexts, and some data of 
value to conceptualizing the possible long-term influences of progams on chilcft'en 
(White. 1988: Powell. 1989; Weiss & Jacobs. 1988). Perhaps the most significant 
contribution of the evaluation process has been the important questions raised in this 
analytic process. While outcome factors have predominated past evaluations, a new 
and more comprehensive perspective is evolving with regards to the potential for 
examining process factors. 

Large scale parent education evaluation scnemes nave a unique roie to play in 
promoting a highly sensitive understanding of parenting, parent-child relationships, 
and family wellness vanables as they might emerge within the creative efforts of 
community prqecte. Unfortunately (and to a iarge degree m reeponee to funding 
pressures), a myopic image of the evaluation process has limited large-scale 
assessments to mostly outcome factors. While elements such as Improved parenting, 
naeased school success, and stronger ^amily-scncci carrnersniDS are cmical to the 
field's "<nowledae base, even more critical is the exoioration of the processes* that 
underlie such advancements and the assessment or :ne aynamics" of how these 
processes influence the entire family s "wellness status" 

n :nis 3ense ataiewice careni ecucaticn evaiuaiicns can isoeciaily contribute 
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to a better underatanding of ieaues such as the followmg: 

*What tt-ie intncaaes of how prog'ams arrive at ther missions, in both tha sansa of 
maao and miao level dynamics? 

•What processes (at macro and r^iiao levels) are used tw arrive at progam priorities; 
and, who. what, and how are these processes actually carried out in projects? 

•What are the dynamics of actually implementing programs, what, who and how are 
these proyam systems carried out? 

•How ere staffing, funding, and training issues integated into progam development 
and evaluation; and., what influences do they have on the multiple variables that 
comprise successful proyam development? 

There are many other issues that deserve attention with regards to the 
•progam/process" elements in parent education Unfortunately, reliance on outcome- 
oriented designs has clouded the need for more critical analyses of process variables. 
The status of parent education, as it emerges in future years, can be strengthened 
ihrough the use of multi-dimensional. ecological evaluation schemes. A highly 
inclusive approach is needed so that we can truiy depict what is possible within high 
quality parent education programs. 
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